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I.  THE  PROBLEMS  STUDIED 


1 


yThe  research  problems  studied  for  the  U.S.  Army  Research  Office  over  the 
six  year  period  of  these  grants  are  each  in  the  research  area  of  Numerical  Linear 
Algebra  and  Applications.  The  objectives  of  the  research  were  to  develop  new 
techniques  for  handling  large-scale  problems  which  involve  iterative  or  direct 
methods  for  solving  large  sparse  systems  of  linear  equations  or.,  least  squares 
problems.  The  topics  to  be  studied  included:  (1)  the  convergence  of  iterative 
methods  for  solving  systems  of  linear  equations,  (2)  hyperbolic  systems  of 
partial  differential  equations,  (3)  large-scale  least  squares  computations, 

(4)  M-matrices  and  related  topics  on  nonnegativity,  (5)  the  computation  of 
stationary  distributions  for  Markov  chains  and  (6)  sparse  matrix  computations 
in  structural  optimization. 


Research  on  these  topics  was  to  be  coordinated  with  associated  scientists 
and  engineers  from  some  of  the  application  areas  such  as  queueing 
network  analysis,  compartmental  analysis  of  biological  systems, 
geodetic  adjustment  methods  and  structural  analysis.  Some  theoretical  research 
was  to  be  done  and  certain  algorithms  and  software  were  to  be  developed  and 
tested  on  real  problems  from  these  areas. 


II.  SUMMARY  OF  MAJOR  RESULTS 


The  most  important  research  accomplishments  by  the  Principal  Investigator 
and  co-workers  are  described  below.  These  results  have  been  obtained  in  six 
areas  of  Numerical  Linear  Algebra  and  Applications. 

1.  Convergence  of  Iterative  Methods  for  Linear  Systems 

Given  a  system  of  linear  equations  Ax  =  b,  consider  the  convergence 


of  the  iterations 


where  H  is  an  iteration  matrix  from  some  splitting  of  A,  that  is,  H  =  M  N, 

with  A  *  M  -  N.  In  joint  work  with  James  Ortega,  the  famous  Ostrowski-Reich 

theorem  for  the  convergence  of  the  iterations,  where  A  is  hermitian  positive 

definite,  has  been  extended  to  the  case  where  A  is  hermitian  but  not  necessarily 

■k 

positive  definite  and  secondly  to  the  case  where  A  is  not  hermitian  but  A  +  A 
is  positive  definite.  In  another  direction,  the  convergence  of  the  iterations 
where  A  is  singular  and  A  *M-Nis  a  regular  splitting  has  been  investigated 
in  joint  work  with  C.  Meyer  and  M.  Neumann.  Three  papers  have  been  written 
on  this  project.  In  particular,  the  paper,  "Convergent  powers  of  nonnegative 
matrices  and  iterative  methods  for  linear  systems",  published  in  1978,  contains 
results  that  have  been  crutial  to  recent  work  on  matrix  methods  for 

queueing  networks  by  Linda  Kaufman  and  others  at  Bell  Laboratories. 

2.  Hyperbolic  systems  of  Partial  Differential  Equations 

In  this  project,  with  M.  Gunzburger,  the  open  problem  of  finding  an 

energy  conserving  norm  for  the  solution  of  a  hyperbolic  system  -jp-  =  A  , 

3 1  oX 

subject  to  boundary  conditions,  was  reduced  to  that  of  characterizing  certain 
matrices  which  can  be  simultaneously  scaled  to  orthogonal  matrices.  Subsequently, 
an  efficient  althorithm  for  such  scalings  was  developed  in  work  with  A.  Berman 
and  B.  Parlett.  Two  papers  were  written  on  this  topic  and  the  results  were 
presented  at  a  conference  on  numerical  analysis  in  Hungary. 

3.  Large-Scale  Least  Squares  Computations 


This  has  probably  been  the  major  focal  point  of  research  by  the 
Principal  Investigator  over  the  past  six  years  and  some  significant  accomplishments 
have  been  obtained  in  joint  work  with  others.  The  primary  application  area  has 
been  in  the  least  squares  adjustment  of  geodetic  data  and  we  have  worked  closely 
with  personnel  from  the  Defense  Mapping  Agency  (DMA)  and  the  National  Geodetic 
Survey  (NGS) .  The  NGS  is  currently  undertaking  the  readjustment  of  the  North 
American  Datum.  In  particular,  trips  were  made  to  these  agencies  in  Washington 
to  discuss  mutual  problems  and  to  exchange  ideas  and  data.  Algorithms  and 
software  for  solving  large-scale  least  squares  problems  was  written  and  tested 
and  parts  of  it  are  currently  being  used  at  the  DMA  and  the  NGS.  This  represents, 
in  part,  joint  work  with  A.  George,  G.  Golub  and  M.  Heath.  A  total  of  six 
papers  have  been  written  on  this  topic  and  several  lectures  have  been  given. 


The  study  of  M-matrices  and  their  properties  involving  nonnegativity 
have  elegant  and  extensive  applications  in  the  mathematical  sciences.  Our  work 
in  this  area  has  involved  characterizations  of  such  matrices,  Lyapunov  stability 
theory  for  differential  equations,  convergent  regular  splittings  of  M-matrices, 
triangular  LU  factorizations  and  backward  error  analysis  for  linear  systems 
associated  with  inverses  of  M-matrices.  Some  of  this  work,  done  jointly  with 
R.  Funderlic  and  M.  Neumann  was  presented  at  the  Gatlinburg  Symposium  held  at 
Oxford,  England  in  1981.  In  addition,  a  research  book  on  this  topic.  Nonnegative 
Matrices  In  the  Mathematical  Sciences ,  Academic  Press  series  on  Applied 
Mathematics  and  Computer  Science,  was  published  along  with  eight  other  publications 
relating  to  M-matrices  and  applications. 

5 .  Computation  of  Stationary  Distributions  of  Markov  Chains 

Consider  an  irreducible  n  *  n  matrix  A  *  (a. .)  with  a. .  <0  for  all  i  ^  j 
n  1J  “ 

and  with  £  a. .  *  0,  1  <_  j  <_  n.  These  matrices  are  called  Q-matrices  and  they 
i-1  3 

arise  in  several  areas,  including  the  analysis  of  queueing  networks  from  whence  the 

name  arises ,  the  analysis  of  biological  compartmental  models  and  the  input-output 

analysis  of  economic  models.  The  solution  p  >  0  to  Ax  *  0,  where  £  p  -  1, 

i-1  1 

is  the  stationary  distribution  vector  associated  with  the  underlying  Markov 
chain  for  the  model.  Work  here,  with  R.  Funderlic  and  W.  Harrod,  has  concentrated 
on  direct  and  combined  direct-iterative  algorithms  for  computing  p  and  on  up¬ 
dating  LU  factorizations  of  A.  These  algorithms  have  been  implemented  and  they 
compare  quite  favorably  with  current  methods  for  computing  p.  Three  papers  were 
written  to  report  these  results. 

6.  Sparse  Matrix  Computations  in  Structural  Optimization 

A  very  promising  and  important  application  of  sparse  matrix  technology 
is  that  of  developing  algorithms  and  software  for  problems  in  structural  analysis 
and  optimal  design.  Given  the  external  loads  on  a  structure,  the  object  of 
structural  analysis  is  to  determine  the  resulting  internal  forces,  stresses  and 
displacements.  This  Involves  solving  a  quadratic  programming  problem. 


min 


T 

F  fF 


such  that  EF  *  P. 


for  Che  internal  force  vector  F,  where  f  is  the  element 

flexibility  matrix,  E  is  the  equilibrium  matrix  and  P  is  the  external  load 
vector.  The  Principal  Investigator,  along  with  joint  authors  M.  Berry, 

M.  Heath,  K.  Kaneko  and  R.  Ward,  have  recently  been  involved  with  developing 
algorithms  and  software  for  using  the  force  method  in  structural  optimization. 
All  of  this  software  was  written  at  N.  C.  State  University.  A  primary  feature 
of  our  work  is  the  development  of  an  efficient  algorithm  for  computing  a  sparse 
and  banded  basis  of  the  null  space  of  E  to  remove  the  redundant  forces.  The 
work  is  incomplete  here,  but  a  research  grant  has  been  made  by  the  Air  Force 
Office  of  Scientific  research  to  enable  the  Principal  Investigator  to  continue 
this  project.  Four  papers  have  been  written  thus  far  on  this  research  and 
results  have  been  presented  at  the  Sparse  Matrix  Symposium  -  1982,  at  the  First 
Army  Conference  on  Applied  Mathematics  and  Computing  and  at  the  Mathematics 
Research  Center,  University  of  Wisconsin. 

To  summarize,  the  Principal  Investigator  feels  that  very  many  of  the 
research  objectives  of  these  two  grants  have  been  met  and  that  the  overall 
results  will  provide  useful  tools  for  scientists  and  engineers  inside  and 
outside  the  Department  of  Defense. 
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